METHOD FOR DETECTING POSITION OF LANE MARKER, 
APPARATUS FOR DETECTING POSITION OF LANE MARKER AND 
ALARM APPARATUS FOR LANE DEVIATION 

5 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a method for detecting a position 
of a lane marker provided on a road surface, an apparatus for detecting a 
10 position of a lane marker and an alarm apparatus for a lane deviation. 

Description of the Prior Art 

Recently, for the purpose of avoiding an accident that occurs by 
drowsy driving or the like, there has been developed a system which 

15 prompts an attention to a driver by raising an alarm when a moving 
vehicle is deviated from a lane marker (lane, white line) provided on a 
road. As a method for recognizing a positional relation between the 
moving vehicle and the lane marker, a Hough transform method is often 
used for a method for detecting a position of the lane marker by 

20 extracting a direct-advancing element from an image of a road surface 
taken by a camera which is provided on a vehicle (for example, see 
Japanese Patent Laid Open S63-142478). 

However, the aforementioned detecting method by use of the 
Hough transform method requires a calculation processing using a 

25 trigonometric function in which computational effort is large, therefore 
there are problems that a system having a high calculation processing 
ability is required, and it is difficult to achieve a process of detecting the 
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position of lane marker in real time. 

SUMMARY OF THE INVENTION 
The present invention has been accomplished in view of the 
5 above mentioned circumstances, and it is an object of the invention to 
provide a method for detecting a position of a lane marker, an apparatus 
for detecting the position of the lane marker and an alarm apparatus for 
a lane deviation, which are capable of detecting the position of the lane 
marker provided on a road surface without performing a considerable 

10 amount of calculation processing. 

To accomplish the aforementioned object, according to the 
method for detecting the position of the lane marker provided on the 
road surface, it comprises steps of photographing an image of the road 
surface by a camera loaded on a vehicle; converting the image of the road 

15 surface taken by the camera into an overlooked image; obtaining an 
integral brightness by integrating a brightness of a coordinate in a 
direction perpendicular to a direction of a road width of the road surface 
that is indicated on the converted overlooked image and detecting the 
integral brightness in every coordinate which is in the road width 

20 direction; and obtaining a position of the road surface corresponding to 
the coordinate in the road width direction in that a high integral 
brightness is indicated. 

To accomplish the aforementioned object, according to the 
apparatus for detecting the position of the lane marker, it comprises 

25 overlooked view converting means for converting an image of a road 
surface taken by a moving vehicle into an overlooked image; brightness 
profile creating means for creating a brightness profile by obtaining an 
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integral brightness which is obtained by integrating a brightness of a 
coordinate in a direction perpendicular to a road width direction of the 
road surface in the converted overlooked image and by detecting the 
integral brightness in every coordinate in the road width direction; high 
5 brightness coordinate detecting means for obtaining the coordinate in 
the road width direction indicating a high integral brightness from the 
brightness profile; and road surface position detecting means for 
obtaining a position of the road surface corresponding to the coordinate 
obtained by the high brightness coordinate detecting means. 

10 The apparatus detects the position of the lane marker by the 

position of the road surface obtained by the road surface position 
detecting means. 

To accomplish the aforementioned object, according to the alarm 
apparatus for the lane deviation, it comprises a device for detecting a 

15 position of a lane marker; distance calculating means for calculating a 
distance between a moving vehicle and a lane marker which is nearest to 
the moving vehicle by the position of the lane marker detected by the 
device for detecting the position of the lane marker; first alarm raising 
means for raising a different alarming sound to a driver corresponding to 

20 the distance calculated by the distance obtaining means. 

The device for detecting the position of the lane marker is 
comprised of overlooked view converting means for converting an image 
of a road surface taken by the moving vehicle into an overlooked image; 
brightness profile creating means for creating a brightness profile by 

25 obtaining an integral brightness which is obtained by integrating a 
brightness of a coordinate in a direction perpendicular to a road width 
direction of the road surface in the converted overlooked image and by 
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detecting the integral brightness in every coordinate in the road width 
direction; high brightness coordinate detecting means for obtaining the 
coordinate in the road width direction indicating a high integral 
brightness from the brightness profile; and road surface position 
5 detecting means for obtaining a position of the road surface 
corresponding to the coordinate obtained by the high brightness 
coordinate detecting means. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 Fig. 1 is a block diagram showing a camera and an apparatus for 

detecting a position of a lane marker relating to an embodiment 1. 

Fig. 2 is a perspective view showing a general position of a 
camera provided on a vehicle. 

Fig. 3 is a view showing an image of a road surface imaged by 
15 using a wide-angle lens. 

Fig. 4 is a view showing an image in which the road surface 
image shown in Fig. 3 is converted into an overlooked view. 

Fig. 5A is a view showing the image shown in Fig. 4. 
Fig. 5B is a graph of the intensity profile indicating a value of an 
20 integral brightness corresponding to a horizontal axis coordinate in Fig. 
4. 

Fig. 6 is a first flowchart showing a process in a lane marker 
detecting unit. 

Fig. 7 is a second flowchart showing the process in the lane 
25 marker detecting unit. 

Fig. 8 is a block diagram showing the camera, an overlooked view 
converting device, an alarm apparatus for the lane deviation and a 
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monitor relating to an embodiment 2. 

Fig. 9 is a flowchart showing a process that a microcomputer of 
the alarm apparatus for the lane deviation carries out. 

Fig. 10 is a view showing an overlooked image which is 
5 compressed in a longitudinal direction. 

Fig. 11 is a view showing the overlooked image of a wide range 
formed by the overlooked view converting device. 

Fig. 12 is a view showing the overlooked image which is 
magnified and formed by connecting separated overlooked images 
10 together. 

Fig. 13 is a block diagram showing the alarm apparatus for the 
lane deviation which a frame memory in the alarm apparatus for the 
lane deviation shown in Fig. 8 is changed with an integration circuit or a 
line memory. 

15 Fig. 14 is a view showing the overlooked image in which an 

overlooked image data is turned into 90 degrees and the intensity profile 
created by using overlooked image which is turned into 90 degrees. 
Fig. 15A is a view showing an ideal intensity profile. 
Fig. 15B is a view showing the intensity profile that is actually 
20 created. 

Fig. 15C is a view showing the intensity profile created by using 
the overlooked image to which a high pass filter is applied. 

Fig. 16 is a view showing the intensity profile created by using 
the overlooked image taken by using the wide-angle lens. 
25 Fig. 17 A is a view showing the temporal change of the intensity 

in the overlooked image in which a low pass filter is not used. 

Fig. 17B is a view showing the temporal change of the intensity 
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in the overlooked image in which a low pass filter is used. 

Fig. 18 is a view showing the flowchart showing a process of 
carrying out an alarming to a driver by detecting a position of lane 
marker. 

5 Fig. 19 is a view showing the intensity profile which a multi-peak 

phenomenon is occurred. 

Fig. 20Ais a view showing the intensity profile. 

Fig. 20B is a view showing a differential profile having carried 
out an intensity conversion by using a differential filter to the intensity 
10 profile shown in Fig. 20A. 

Fig. 21 A is a view showing a sound volume and a frequency that 
are raised as an alarming sound and a corresponding relation of a 
distance between a lane marker and the vehicle. 

Fig. 2 IB is a view showing an example of the distance between 
15 the vehicle and the lane marker. 

Fig. 22 is a first flowchart showing a process for the 
microcomputer to carry out the alarming. 

Fig. 23 is a second flowchart showing the process for the 
microcomputer to carry out the alarming. 

20 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
<Embodiment 1> 

An apparatus for detecting a position of a lane marker according 
to an embodiment 1 will be described hereunder with reference to the 
25 accompanying drawings. Fig. 1 is a block diagram to show the 
apparatus for detecting the position of the lane marker 1 relating to the 
present invention and a camera 2. 
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The camera 2 is a CCD camera capable of shooting widely 
provided with a wide-angle lens and loaded onto a rear part of a vehicle 3 
as shown in Fig. 2. The camera 2 is disposed in such a manner as to 
obliquely overlook a road surface 4 which is at right behind the vehicle. 
5 The road surface 4 is imaged so that frames 6 and 7 at above and below 
of the camera 2 become substantially parallel with a horizontal line 5 (it 
does not become completely parallel when using the wide-angle lens) like 
an image indicated in Fig. 3, and the image becomes such an image that 
a peripheral part is curved compared with a center part. 

10 The apparatus for detecting the position of the lane marker 1 

provided with an overlooked view converting unit 8, an intensity profile 
creating unit 9, a memory unit 10 and a lane marker detecting unit 11. 
The overlooked view converting unit 8 corrects a distortion of the image 
of the road surface which is taken by the camera 2, and for converting 

15 the corrected image into an overlooked image which is an image that 
overlooks direct underneath from an upper part of the vehicle 3. Also, 
the overlooked view converting unit 8 enlarges or shrinks the image if 
required. For example, the overlooked view converting unit 8 converts 
the image of the road surface as shown in Fig. 3 into the image 

20 overlooked and then the converted overlooked image is displayed as 
shown in Fig. 4. In addition, an art to convert the photographed image 
into the overlooked image is disclosed in Japanese Patent Laid Open Nos. 
H3-99952, H9-171348, 2001-114048 and 2001-116567, therefore its 
description is omitted as it is well known. 

25 The intensity profile creating unit 9 inputs the overlooked image 

that is converted by the overlooked view converting unit 8. The 
intensity profile creating unit 9 determines the overlooked image by 
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setting a direction of a road width of the road surface which is indicated 
in the overlooked image as a direction of a horizontal axis Y and a 
direction perpendicular to the horizontal axis Y as a direction of a 
vertical axis X. Then the intensity profile creating unit 9 obtains an 
integral brightness by integrating brightness in the vertical axis X 
direction and creates an intensity profile (brightness profile) which the 
integral brightness is arranged in every coordinate (pixel) of the 
horizontal axis Y. Since the overlooked image is constituted by a group 
of a plurality of pixel arranged in the X direction and the Y direction, the 
integral brightness can be obtained from every pixel arranged in the Y 
coordinate of the horizontal axis. When the vehicle 3 drives a straight 
road, a direction of a lane marker 13 (for example, center line or 
boundary line) formed on the road surface extending become as the 
direction of the vertical X direction since the camera 2 is loaded in such a 
manner as to image the right behind of the vehicle 3. The memory unit 
10 stores the intensity profile created by the intensity profile creating 
unit 9 and stores data such as a specified width L of the common lane 
marker 13. 

Fig. 5B is a graph indicating the intensity profile to the 
overlooked image shown in Fig. 4 (Fig. 5A). Although the lane marker 
13 is generally depicted in bright colors having high brightness like 
white or yellow, such colors having low brightness like gray are used on 
the road surface 4. Therefore, when comparing a position having the 
lane marker 13 with a position not having the lane marker 13 in the 
overlooked image, the integral brightness in the coordinate having the 
lane marker 13 indicates a distinctly high value. For example, the 
coordinate indicates the highest integral brightness in the intensity 



profile shown in Fig. 5B corresponds to the coordinate on the horizontal 
axis Y of the lane marker 13 which is indicated in such a manner as to 
extend in the vertical X direction of the image in Fig. 4 (Fig. 5A). 

It is possible to widen a difference of the integral brightness 
5 between the lane marker 13 and other lane markers 14 (designs or 
markers such as speed limit indications that are provided on the road, 
for example "40" in Fig. 4 and Fig. 5 A) since a length of an indication of 
the other markers 14 become relatively shorter than a displayed length 
of the vertical X direction of the lane marker 13 by widening an area that 

10 the overlooked image can be displayed with shrinking the overlooked 
image by the overlooked view converting unit 8. 

The lane marker detecting unit 11 obtains the coordinate which 
is on the horizontal axis Y that indicates the high integral brightness in 
the intensity profile and determines the position of the lane marker 13 

15 from the obtained coordinate. A flowchart shown in Fig. 6 is a first 
flowchart showing a process of detecting the position of the lane marker 
in the lane marker detecting unit 11. 

First of all, the lane marker detecting unit 11 detects the 
coordinate of the horizontal axis Y (for example, it is Yl in the intensity 

20 profile shown in Fig. 5) that indicates the highest value of the integral 
brightness from the intensity profile (step SI), and retrieve the obtained 
coordinate and the value of the integral brightness of the coordinate in 
proximity of the obtained coordinate (step S2). Then the lane marker 
detecting unit 11 determines whether the integral brightness is 

25 generated by a noise or a data other than the noise (correct data) from 
the obtained value of the integral brightness (step S3). To be more 
precise, the lane marker detecting unit 11 compares the integral 
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brightness of the detected coordinate between the integral brightness of 
the coordinate that is in adjacent to the coordinate thereto, and when 
the integral brightness between the detected coordinate and the 
adjacent coordinate indicate almost the same value, then the lane 
5 marker detecting unit 11 determines that it is the correct data, since it 
can be considered that the coordinate indicating the similar integral 
brightness to the specified width L of the lane marker 13 is continued. 
In addition, the lane marker detecting unit 11 determines that it is 
generated by the noise when only either of the detected coordinate or the 

10 coordinate that is adjacent to the detected coordinate indicates the 
exceedingly high integral brightness. 

When the lane marker detecting unit 11 judges that the integral 
brightness of the indicated coordinate is generated by the noise, then it 
removes the integral brightness of that coordinate from an object for the 

15 detection of the coordinate (step S4) and carries out the detection of the 
coordinate indicating the highest integral brightness again (step SI). 
When the lane marker detecting unit 11 judges that the integral 
brightness of the detected coordinate is the correct data (which means 
that it is not the noise), it stores it to the memory unit 10 by determining 

20 that the detected coordinate is the position of the lane marker (step 5). 
Then, the lane marker detecting unit 11 deletes a data of the integral 
brightness of the coordinate of a coordinate width which corresponds to 
the specified width L of the lane marker 13 by setting the position of the 
lane marker as a center (step S6), and repeats the same process again if 

25 the process of detecting the position of the lane marker is a first time 
and completes the process if it is not the first (if the process is after a 
second time) time (step S7). 
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If the process is the first time, the lane marker detecting unit 11 
obtains the coordinate that indicates the highest integral brightness 
except for the coordinate detected for the first time (step SI, step S2), 
then detects a position of a second lane marker after determining that 
5 the integral brightness of the obtained coordinate is whether or not 
generated by the noise (step S3) and records to the memory unit 10 (step 
S5). Generally, since the lane marker 13 is provided on right and left 
sides of the road, it is possible to detect the position of the lane marker 
at the right and left sides by determining the position of the lane marker 
10 twice. 

As described above, the apparatus for detecting the position of 
the lane marker 1 is capable of detecting the position of the lane marker 
without carrying out the considerable amount of calculation such as 
carrying out the trigonometric function by creating the intensity profile 

15 after the photographed image is converted into overlooked view by using 
the overlooked view converting process and detecting the position of the 
lane marker by obtaining the coordinate indicating the highest integral 
brightness, so it is possible to detect the position of the lane marker 
faster by using a simpler system than a case detecting the position of the 

20 lane marker by a process of extracting a direct-advancing element 
utilizing a Hough transform method. 

In particular, the apparatus for detecting the position of the lane 
marker 1 relating to the embodiment 1 is more suited for detecting the 
position of the lane marker at the area relatively close to the vehicle 3 

25 than detecting the position of the lane marker in the distance since it 
creates the overlooked image according to the image of the road surface 
at a vicinage of the vehicle 3, therefore it becomes the most suitable 
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detecting apparatus for a system such as a system for alarming a lane 
deviation. 

The flowchart shown in Fig. 7 is a second flowchart showing the 
process of detecting the position of the lane marker in the lane marker 
5 detecting unit 11. Although the detecting process of the position of the 
lane marker is carried out by obtain the coordinate indicating the 
highest integral brightness in the first flowchart, there is a difference in 
the second flowchart in that the detecting process of the position of the 
lane marker is carried out by obtaining the coordinate width (pixel 

10 width) 1 (small alphabet L) of group of the coordinate which is the 
coordinate having the highest integral brightness as well as the 
coordinate proximity to thereto and indicates the relatively higher 
integral brightness than the other coordinate, and then comparing the 
coordinate width 1 with the specified width L of the lane marker. The 

15 description will be made with giving the same reference numerals to the 
processes same as in the first flowchart shown in Fig. 6. 

First of all, the lane marker detecting unit 11 detects the 
coordinate indicating the highest integral brightness from the intensity 
profile (step SI) and obtains the group of coordinate width 1 indicating a 

20 value of the high integral brightness by obtaining the value of the 
integral brightness of the detected coordinate and the coordinate 
proximity to thereto (step S2'). Then, the lane marker detecting unit 11 
detects whether or not the obtained coordinate width is similar width to 
the specified width L of the lane marker 13 that is stored in the memory 

25 unit 10 by considering a change of the value of the integral brightness to 
whole coordinate of the horizontal axis Y (step S3'). When the lane 
marker detecting unit 11 judges that the obtained coordinate width 1 
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does not correspond to the specified width L of the lane marker 13, then 
it removes the integral brightness of the corresponding coordinate from 
an object for the detection of the coordinate (step S4') and carries out the 
detection of the coordinate indicating the highest integral brightness 
5 again (step SI). 

When the lane marker detecting unit 11 judges that the obtained 
coordinate width 1 and corresponding specified width L of the lane 
marker 13 are similar width, it stores the fact to the memory unit 10 by 
determining that the coordinate at a center part of the coordinate width 1 

10 as the position of the lane marker (step S5'). Then, the lane marker 
detecting unit 11 deletes a data of the integral brightness of the group of 
coordinate from the intensity profile (step S6'), and repeats the same 
process again if the process of detecting the position of the lane marker 
is the first time and completes the process if it is not the first (if the 

15 process is after the second time) time (step S7). 

As described above, the apparatus for detecting the position of 
the lane marker 1 is capable of detecting the position of the lane marker 
without carrying out the considerable amount of calculation such as 
carrying out the trigonometric function by creating the intensity profile 

20 after carrying out the converting of the image to overlooked view by 
using the overlooked view converting process and detecting the position 
of the lane marker by obtaining the coordinate width of the group of 
coordinate having the high integral brightness. 

It is, therefore, possible to detect rapidly the position of the lane 

25 marker by using a system simpler than a case detecting the position of 
the lane marker by a process of extracting a direct-advancing element 
utilizing the Hough transform method as similar to the process shown in 
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the first flowchart. In addition, the apparatus for detecting the position 
of the lane marker 1 can carry out the process in real time easily as it is 
not necessary to carry out the considerable amount of obtaining process. 

Furthermore, the apparatus for detecting the position of the 
5 lane marker 1 becomes easier to determine the difference between the 
lane marker and the other marker (designs or markers such as speed 
limit indications that are provided on the road) since it carries out the 
detecting process of the position of the lane marker according to the 
coordinate width of the group of coordinate, therefore it becomes easy to 

10 reduce the false detection of the position of the lane marker. 
<Embodiment 2> 

Hereinafter an alarm apparatus for a lane deviation will be 
described with reference to the accompanying drawings. As shown in 
Fig. 8, the alarm apparatus for the lane deviation 20 is connected with 

15 an overlooked view converting device 21 and a monitor 22. The 
overlooked view converting device 21 carries out the process 
corresponding to the overlooked view converting unit 8 described in the 
embodiment 1. The overlooked view converting device 21 creates the 
overlooked image shown in Fig. 4 by applying an observing point 

20 conversion to such an image shown in Fig. 3 that is taken by the camera 
2. 

The alarm apparatus for the lane deviation 20 is provided with a 
frame memory 23, a microcomputer 24, a working memory 25, an 
encorder 26 and an alarm apparatus 27. The alarm apparatus for the 

♦ 

25 lane deviation 20 creates the intensity profile by using the overlooked 
image created by the overlooked view converting device and raises an 
alarm regarding the lane deviation to a driver if necessary by detecting a 
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positional relation between the vehicle 3 and the lane marker 13 by 
using the created intensity profile. 

The frame memory 23 is a memory which is used to synchronize 
when creating the intensity profile. The overlooked image created by 
5 the overlooked view converting device is stored in the frame memory 23. 
By the way, there may be a case that a line memory is used as a 
substitute for the frame memory 23 in light of processing speed of the 
microcomputer 24, cost or the method for creating the intensity profile 
for example. The case that the line memory is used will be described 
10 later. 

The microcomputer 24 creates the intensity profile by using the 
overlooked image stored in the frame memory 23. In addition, the 
microcomputer 24 obtains a traveling speed (traversing speed) to a 
direction of width of the vehicle 3 by detecting a steering angle of a 

15 steering wheel using a steering angle sensor which is not shown and by 
obtaining speed information using a velocity sensor which is not shown. 
By the way, there has been known a method for obtaining the traversing 
speed by using a method to extract vehicle information using 
vehicle-mounted information equipment such as the steering angle 

20 sensor and the velocity sensor, or a method for obtaining the traversing 
speed by an image processing. In the case of the alarm apparatus for 
the lane deviation 20, the microcomputer 24 is capable of determining 
whether the vehicle 3 is getting closer to or getting away from the lane 
marker 13 by using the steering angle sensor and capable of obtaining 

25 the traversing speed quantitatively by using the velocity sensor. In the 
vehicle 3 that is provided with the vehicle-mounted information 
equipment such as a navigation device, it is possible to provide the 
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microcomputer 24 so as to detect the traversing speed by obtaining the 
information regarding a movement of the vehicle 3 since the movement 
of the vehicle 3 can be checked at all times by using, for example, a yaw 
rate sensor (acceleration sensor). 
5 By the way, the speed of the obtaining process of the traversing 

speed varies according to a processing ability of the microcomputer 24 
when carrying out a method of obtaining the traversing speed by the 
image processing. For example of the method utilizing the image 
processing to obtain the traversing speed, track the position of the lane 

10 marker which is on the screen in every frame and check a moving 
distance at an inter-frame so as to carry out the detection to detect 
whether the vehicle 3 is getting closer or getting away from a white line 
in every frame. The speed can be determined since the time of 
inter-frame is approximately 30m/sec. 

15 Moreover, the microcomputer 24 determines whether or not the 

vehicle 3 is not deviated the lane by using a result of the detection of the 
traversing speed of the vehicle 3 and the result of the intensity profile 
obtained by the overlooked image. When the microcomputer judges 
that the vehicle is deviating the lane, the microcomputer 24 raises an 

20 alarm to the driver by using the alarm apparatus 27. To be more 
precise, the microcomputer 24 determines whether or not the vehicle 3 is 
moving to a sideling direction to the detected position of the lane marker 
at over predetermined speed, by creating the intensity profile by the 
overlooked image (step Sll) and detecting a peak position of the integral 

25 brightness where the position of the lane marker is detected (step S12) 
and detecting the aforementioned traversing speed (step S13) as shown 
in Fig. 9. When the microcomputer 24 determines that a possibility the 
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vehicle deviates the lane is high, then the microcomputer 24 raises the 
alarm by using the alarm apparatus 27 (step S14). 

Generally, an acoustic alarm device which raises a buzzer sound 
is used for the alarm apparatus 27, but it is also possible to display a 
5 warning message on the monitor 22 by converting it into an analog 
signal through the encorder 26 if necessary. Therefore, when raising 
the alarm with only the acoustic alarm device, the encorder 26 or the 
monitor 22 shown in Fig. 8 is not required. 

Hereinafter, a method to reduce a false recognition of the lane 
10 marker and a method that is used when the vehicle 3 deviated the lane 
(lane marker) 13 in the detection using the alarm apparatus for the lane 
deviation 20 will be described. 

At first, a description on a method for converting an image for 
enhancing a detection accuracy of the lane marker 13 will be made 
15 hereunder. 

In the alarm apparatus for the lane deviation 20 relating to the 
present invention, the overlooked image provided with a ratio of 
up-down to right-left or an aspect ratio in overlooked image, which is 
proper for detecting the lane marker 13 is used to create the intensity 
20 profile. 

Heretofore, the microcomputer 24 has used the overlooked image 
having the aspect ratio having equivalent magnification created by the 
overlooked view converting device 21 to create the intensity profile. On 
this account, in the overlooked image, when attempting to create the 
25 overlooked image having a wide ranged displayed area by setting a 
position of a point of view in a process of converting the point of view to a 
higher position so as to overlook the lane marker 13 at forward of the 
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vehicle, the displayed area not only widens to a direction of extending 
along the road (longitudinal direction) but also widens to a direction of 
the road-width (lateral direction). For example, not only the images of 
the lane markers 13 and 13a but also the images such as a side wall 31 
5 or a median 32 intrude in the overlooked image as shown in Fig. 11. It 
is extremely difficult for the microcomputer 24 to carry out the 
determination of the position of the lane marker 13 by using the 
intensity profile created by the above method, since the intensity profile 
is created by using the above mentioned overlooked image, the integral 
10 brightness (hereinafter, intensity) other than the lane markers 13 and 
13a such as the side wall 31 or the median 32 appears on the intensity 
profile. 

Given this factor, the microcomputer 24 is capable of inputting 
only the lane marker necessary for the lane marker detection in wide 

15 range to a direction that the vehicle moves without causing the side wall 
31 or the median 32 to generate the false recognition to the overlooked 
image as shown in Fig. 10, by extracting the overlooked image with 
limiting the width thereof to approximately 1m to 1.5m width of the 
vehicle 3 at the step the overlooked image is created by the overlooked 

20 view converting device 21 prior to the creation of the intensity profile, 
and by further compressing the extracted overlooked image to the 
moving direction of the vehicle (longitudinal direction). 

By using an art of creating the overlooked image by compressing 
the image of the moving direction of the vehicle to the image of the 

25 direction of the road-width by the microcomputer 24 (art of 
non-equivalent magnification of the overlooked image), the alarm 
apparatus for the lane deviation 20 is capable of detecting the intensity 
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value of the lane width of the lane marker 13 even more higher when 
creating the intensity profile and is capable of suppressing the detection 
of other peak intensity that provokes the false recognition. 

Also, as shown in Fig. 12, it may also be recommendable to delete 
a part 13c which is a similar width to the vehicle width and extending in 
the moving direction of the vehicle (longitudinal direction), and the 
microcomputer 24 slightly magnifies separated overlooked images which 
are separated in right and left and connects them together so as to create 
a new overlooked image. By creating the intensity profile by using the 
overlooked image created by the aforementioned method (art of 
separation overlooked images), it is possible to avoid the detection of the 
various markers that are depicted in the vicinity of the center of the lane 
such as the speed limit indications (relevant to "40" in Fig. 12) as the 
peak intensity when creating the intensity profile. 

Additionally, it is possible to enhance the detecting accuracy of 
the position of the lane markers 13 and 13a by the alarm apparatus for 
the lane deviation 20 easily since the lane markers 13 and 13a are also 
magnified to be displayed by the magnification of the divided overlooked 
images. 

Still additionally, the alarm apparatus for the lane deviation 20 
is capable of using the created overlooked image as an effective 
determining element in the determination of the deviation of the vehicle 
3, since it can be determined that the vehicle 3 is deviated the lane when 
part of the lane marker is not displayed in the overlooked image which 
the part of the vehicle-width is deleted. 

As described above, the alarm apparatus for the lane deviation 
20 is capable of enhancing the detecting accuracy of the position of the 
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lane marker by processing the overlooked image used when creating the 
intensity profile by using the art of non-equivalent magnification 
overlooked image or the art of separation overlooked image. 

Next, a method of enhancing a processing speed of the process of 
5 detecting the position of the lane markers 13 and 13a will be described 
hereunder. Fig. 13 shows an alarm apparatus for a lane deviation 20' 
which the processing speed of the detection of the position of the lane 
marker is enhanced. 

First of all, the microcomputer 24 stores the overlooked image 

10 created by the overlooked view converting device 21 to the memory 33. 
The line memory or an integration circuit is used for the memory 33 
rather than the frame memory described in Fig. 8. The microcomputer 
24 records information regarding a one line portion of the vertical axis of 
the overlooked image to the line memory 33 and carries out the detecting 

15 process of the integral brightness in a one portion of a scanning line of 
image information. To be more precise, as shown in Fig. 14, the 
microcomputer 24 carries out the process of an image data of the vertical 
direction as the image data of the one line portion of the scanning line of 
the overlooked image that is turned in 90 degrees. Consequently, by 

20 creating the intensity profile by using the overlooked image extracted in 
every one lines, it is possible to distribute and reduce the process of 
creating the intensity profile carried out in the microcomputer 24. 

When creating the intensity profile by using a conventional 
method, the microcomputer 24 once inputs all the image data regarding 

25 the overlooked image to the microcomputer 24 and then carries out a 
summing calculation to the vertical direction, that is, to a perpendicular 
direction within the memory of the microcomputer 24. However, the 
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alarm apparatus for the lane deviation 20 can omit the process for 
transferring all the image data to the microcomputer 24, since the alarm 
apparatus for the lane deviation 20 is capable of detecting the intensity 
(integral brightness) of each lines by adding signal that flows 
5 continuously in every scanning line in every one line by the line memory 
33 without inputting all the image data of the overlooked image to the 
microcomputer 24. Furthermore, the alarm apparatus for the lane 
deviation 20 is capable of creating the intensity profile easily by only 
carrying out an addition of a brightness signal of the one line portion of 

10 the scanning line by a simple integration circuit (not shown). 

When the overlooked image outputted from the overlooked view 
converting device 21 is the analog signal (for example, NTSC signal in 
black and white), the integration circuit carries out a voltage out by 
integrating by an analog integration circuit and digitalize the voltage by 

15 an A/D converter. In addition, since the microcomputer having a 
built-in A/D converter exists nowadays, it is possible to directly read the 
analog signal as an integrated result by utilizing such microcomputer. 
By the way, the analog integration circuit carries out a re-set by 
synchronize with a horizontal synchronization signal. On the other 

20 hand, when the overlooked image is outputted in a digital signal, then 
directly read out by the microcomputer by adding with a full adder. 

Since it is possible to divide the process of creating the intensity 
profile into every one portion of the scanning line by using the above 
mentioned method, the alarm apparatus for the lane deviation 20' can 

25 reduce the process of the microcomputer 24 by providing a compact sized 
hardware which carries out the process of creating the intensity profile. 
In addition, the alarm apparatus for the lane deviation 20' is also 
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possible to carry out the process of creating the intensity profile without 
subject to a performance of the microcomputer 24 since the process of the 
microcomputer 24 can be reduced. Also, as the process of reading all 
the image data by the microcomputer 24 becomes unnecessary, the alarm 
5 apparatus for the lane deviation 20' can reduce the time taking for the 
process of reading all the image data (in a conventional processing 
method, there have been a situation the reading process of the image 
data occupies over half of the entire processing time). Since an amount 
of reading data of the microcomputer 24 can be reduced to 1/several 

10 hundreds (resolution of the horizontal axis), the alarm apparatus for the 
lane deviation 20' can distribute a calculatable resources to the intrinsic 
process, which is, to detect the lane marker and to carry out the process 
of alarming of the lane deviation even more. 

Next, a method for enhancing an accuracy of detecting the peak 

15 intensity of the lane marker 13 in the detection process of the lane 
marker 13 will be described hereunder. 

When the intensity profile created by the overlooked image is an 
ideal one, such peak intensity is detected in the intensity profile as 
shown in Fig. 15A. However, in fact, there are many cases that a peak 

20 shape becomes ambiguous in such a circumstance that a value of the 
peak intensity is generally being increased as shown in Fig. 15B since 
the intensity is also detected from a background signal of the road 
surface part other than the lane marker 13. On this account, the 
microcomputer 24 carries out a process of reducing the intensity of the 

25 background signal by using a high pass filter as a process of bringing 
such peak intensity detected in Fig. 15B closer to the peak shape shown 
in Fig. 15A when creating the intensity profile. Fig. 15C shows the 
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intensity profile having reduced the intensity by using the high pass 
filter. 

By using the high pass filter, the alarm apparatuses for the lane 
deviation 20 and 20' is not only capable of removing the background 
5 signal by reducing an intense low-frequency element, but also capable of 
reducing the false detection of the position of the lane marker by 
lowering the intensity of a wide ranged signal (such as a speed limitation 
marker on the road) with a selection of an appropriate cutoff frequency. 

Also, if the wide-angle lens is used in the camera 2, it becomes 

10 darker as it goes to peripheral part of the image as shown in Fig. 16 due 
to a trait of lens of the wide-angle lens, and leads to such a circumstance 
easily that the intensity of the intensity profile deteriorates at both sides 
of the image. Therefore, the false detection easily occurs because it 
becomes difficult to carry out a comparison of the intensity between each 

15 peak if having evenly reduced only the low-frequency element having the 
constant intensity regardless of the uneven background signal. The 
alarm apparatuses for the lane deviation 20 and 20' are capable of 
reducing only the parts corresponding to the background signal as shown 
in Fig. 16 even in the case of using the wide-angle lens to the camera 2, 

20 because the high pass filter can remove the background signal having 
gradual changes. 

Moreover, since the lane markers 13 and 13a are provided 
continuously to the lane, the detecting position of the lane marker 13 
detected by the lane marker position detection does not change 

25 significantly compared with before detection and after detection of the 
detecting position. Consequently, the alarm apparatuses for the lane 
deviation 20 and 20' are capable of enhancing the detecting accuracy by 
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creating the intensity profile in view of a temporal change of the 
detected intensity when creating the intensity profile. 

For example, in a case of detecting the intensity of the lane 
marker 13a that is depicted by interspaced lines, there may be a case 
5 that the interspaced lined lane marker 13a is not displayed completely 
on the overlooked image depending on a timing of shooting when a 
mounted angle of the camera provided on the vehicle is close to the 
vertical direction of the vehicle and that cannot shoot so much away, 
therefore there is a possibility that the interspaced lined lane marker 

10 13a cannot be detected even if the overlooked image is compressed in the 
vertical direction as shown in Fig. 10. In such a case, it is 
recommended to create the intensity profile in view of the temporal 
change in the overlooked image by using the before detection and the 
after detection of overlooked image. 

15 However, there is a possibility that the peak intensity of the 

interspaced lined lane marker 13a is falsely detected as the noise or the 
like since the value of the intensity in the interspaced lined lane marker 
13a becomes relatively low even when the intensity profile is created in 
view of the temporal change. 

20 Therefore, the microcomputer 24 carries out a compensation of 

the brightness signal in the interspaced lined lane marker 13a by 
creating the intensity profile with using a low pass filter for the 
temporal change of the peak intensity. Fig. 17A shows an intensity 
change in the detected position of the interspaced lined lane marker 13a 

25 is temporally changed by without using the low pass filter, and Fig. 17B 
shows it is temporally changed by using the low pass filter. The peak 
intensity is regularly appearing as a signal since the peak intensity is 



-24- 



always detected by filtering the temporal change by the low pass filter. 
By using the low pass filter to a position of the interspaced lined lane 
marker, the alarm apparatuses for the lane deviation 20 and 20' are 
capable of carrying out the position detection of the interspaced lined 
5 lane marker 13a in any moment. By the way, there may be a case the 
interspaced peak intensity does not appear on the correct position when 
abrupt lane change is carried out, since a proportion of a past intensity 
is high at the place where the intensity of the signal is low (hereunder, 
such phenomenon is stated as a multi-peak phenomenon). In such a 

10 case, the detection of the intensity is carried out by using a "multi-peak 
correspondence process" which will be described later. 

It may be recommendable to adapt the alarm apparatuses for the 
lane deviation 20 and 20' to determine the position of the lane marker 
comprehensively by memorizing several lane models (model of the lane 

15 marker) previously and comparing with information on the lane marker 
13 that is detected by the intensity profile rather than only determining 
the position of the lane marker 13 by creating the intensity profile based 
on the overlooked image. 

The lane model represents a data model having quantified 

20 characteristic information on the lane mainly on the lane width of the 
lane markers 13 and 13a, or distance between the adjacent lane markers 
13 and 13a, which is defined based on a common measurement of the 
lane marker or regulation. Fig. 18 shows a flowchart representing the 
process of alarming the driver when the microcomputer 24 is determined 

25 that the vehicle 3 is deviating of the lane by detecting the position of the 
lane marker by using the alarm apparatus for the lane deviation 20. 

First of all, the microcomputer 24 loads the lane model and 
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records it to the working memory 25 (step S20), then decides the peak 
intensity that is estimated as the lane markers 13 and 13a by creating 
the intensity profile of the overlooked image created by the overlooked 
view converting device 21 and compares it with the loaded lane model 
5 (peak detecting process for a candidate of the white line: step S21). The 
microcomputer 24 repeats the same process for predetermined times 
such as 30 times (step S22) and after having compared the peak 
intensity and the lane model for more than the predetermined times, the 
microcomputer 24 at first determines whether the value obtained by the 
10 comparison is stable (consistently constant) or not (step S23). 
Concretely speaking, the microcomputer 24 determines the stability 
based on whether distribution of the compared value between the peak 
intensity in the predetermined times having repeated in the step S21 
and the lane model is in certain range (step S23). When determining 
15 that it is unstable, the microcomputer 24 obtains how many times has 
the microcomputer 24 determined that it is unstable based on the loaded 
lane model (step S24). The microcomputer 24 changes the lane model 
(step S25) when the number of times having determined unstable in the 
step S23 is over the predetermined times, which is 10 times for example, 
and if it is less than the predetermined times, then repeats the peak 
detecting process for the candidate of the white line (step S21) by using 
the same lane model again. In a case of changing the lane model (step 
S25), the microcomputer 24 determines whether there is the lane model 
that hasn't being loaded yet within the previously recorded lane model 
25 (step S26). If there is the lane model that is not loaded, then loads the 
next lane model (step S20) and if there is no other lane model remaining, 
then carries out an error processing by determining that there is no lane 



20 
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model that corresponds to the memorized lane model, which is to be 
more precise, finishes the process by informing to the driver that there is 
no corresponding lane model (step S27). 

When the microcomputer 24 is determined that it is stable in the 
5 step S23, decides the lane model (step S28) and determines whether the 
lane model that is decided by an average of the compared value between 
the peak intensity and the lane model is adequate or not (step S29). In 
concrete terms, the microcomputer 24 determines whether or not it is 
adequate based on whether a shift width between the lane width of the 

10 lane marker detected by the intensity profile and the adjoining lane 
marker is within an allowable range. For example, when the shift of 
the lane width of the lane marker 13 is within 20-30% and the shift of 
the lane width of the adjoining lane markers 13 and 13a is within 
10-15%, then the microcomputer 24 determines as adequate. When the 

15 microcomputer 24 is determined the lane model is as inadequate, the 
microcomputer 24 loads the next lane model (step S20), and carries out 
the peak detecting process for the candidate of the white line (step S21). 
If it is adequate, then carries out a white line tracking process. 

In the white line tracking process, the microcomputer 24 

20 exercises the peak detecting process for the candidate of the white line 
which is carried out in the step S21 and carries out the detection of the 
lane marker position by obtaining the intensity profile by the overlooked 
image (step S30). Then, the microcomputer 24 determines whether the 
detected lane position has not drastically been changed in comparison 

25 with the lane marker position detected immediately before, that is, 
carries out the determination of whether the change in the lane position 
is continuous or not (step S31). If it is not continuous, the 
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microcomputer 24 determines as the vehicle 3 has changed the lane or a 
road situation is changed (for example, the number of lanes have 
changed, the road width is changed or entered to different road by 
turning at an intersection) and carries out the process in the step 20 in 
5 order to detect the lane model that corresponds to the changed lane or 
the road surface. When the lane marker position is continuously 
changing, the microcomputer 24 determines whether the vehicle is not 
deviating or whether there is the possibility of deviating the lane marker 
by carry out the determination based on the lane model which the 

10 position of the changed lane markers 13 and 13a is decided (step S32). 
If there is the possibility of deviating, then the microcomputer 24 alarms 
the driver, and if there is no possibility of deviating, then the 
microprocessor 24 carries out the peak detecting process for the 
candidate of the white line again (step S30) and repeats the white line 

15 tracking process. 

As described above, the alarm apparatuses for the lane deviation 
20 and 20' are capable of determining easier and faster than in a case 
determining the position of the lane marker without using the lane 
model, by carrying out the determination of the deviation of the lane by 

20 comparing the detected peak intensity with the lane model. Also, since 
the alarm apparatuses for the lane deviation determine the change of 
the vehicle in traveling situation and changes in road circumstance by 
the continuity of the detected lane marker, it is possible to detect a 
presence of the changes when the changes are occurred, and furthermore, 

25 it is possible to correspond to a circumstance of a new road quickly. 

In addition, even if the aforementioned multi-peak phenomenon 
is occurred by carrying out the determination of the lane deviation using 
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the above mentioned lane model, the alarm apparatuses for the lane 
deviation 20 and 20' can detect the correct position of the interspaced 
lined lane marker 13a (multi-peak correspondence process). 

The multi-peak phenomenon occurs easily in a case of creating 
5 the intensity profile utilizing past information by using the low pass 
filter in order to carry out the detection of the interspaced lined lane 
marker 13a, for example, in such a case that the vehicle is swayed 
largely due to operation of the lane change or the like when creating the 
intensity profile. Fig. 19 shows the intensity profile that the 

10 multi-peak phenomenon is occurred. Although width of the peak in the 
peak intensity of the lane marker 13 continues in the direction of 
traveling only becomes slightly wide as shown by a reference numeral 30, 
a plurality of small peak appears in the case of the interspaced lined 
lane marker 13a. It is difficult to determine which is the correct peak 

15 when a space between each peak is narrow in the intensity profile the 
plurality of small peaks is appeared. 

When such multi-peak phenomenon is appeared as shown in Fig. 
19, the microcomputer 24 determines a part indicating the highest value 
of the intensity peak (the peak indicated as the reference numeral 30 in 

20 Fig. 19) as showing the peak intensity of the continuing lane marker 13. 
Next, the microcomputer 24 estimates the peak intensity indicating the 
interspaced lined lane marker from information on the position of the 
interspaced lined lane marker of the lane model by obtaining the 
continuing lane marker by the lane model and carries out a concrete 

25 coordination between the lane marker position of the lane model and 
position of the peak intensity of the intensity profile by presuming that 
the part indicating the highest value of the intensity profile corresponds 
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to the continuing lane marker. Consequently, it is possible to obtain the 
correct position of the lane marker 13a even in the case the multi-peak 
phenomenon is occurred by utilizing the lane model. 

It should be understood that the multi-peak correspondence 
process is not to be limited in the case in the multi-peak phenomenon 
occurs. For example, when the particular position of the lane marker is 
certain, it is possible to obtain the position of other lane marker from the 
lane model based on the certain position of the lane marker. In addition, 
the alarm apparatuses for the lane deviation 20 and 20' can obtain the 
position of other lane marker in accurate manner regardless of the 
presence of the multi-peak phenomenon by obtaining the lane marker 
position by using the multi-peak correspondence process routinely. 

Next, a method of detecting the position of the lane marker and 
the lane width in accurate manner by using a differential filter will be 
described hereunder. 

Although the process for reducing the intensity of the 
background signal by using the high pass filter so as not to detect the 
background signal as the intensity profile has been described in Fig. 15, 
an art utilizing the high pass filter has an advantage that its process is 
relatively easy, on the other hand, there is a problem that it is difficult to 
correctly evaluate the lane marker position by using the lane model, 
because the peak shape changes by the influence of high pass filter. In 
this connection, although it may place some burden on the 
microcomputer 24 compared with the case utilizing the high pass filter, 
it is possible to enhance the detecting accuracy of the lane marker 
position and the width of the lane marker by carrying out the detection 
of the lane marker position after changing the intensity of the intensity 
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profile by using the differential filter. Fig. 20A shows the intensity 
profile which is before applying the differential filter, and Fig. 20B 
shows a differential profile having applied the differential filter to Fig. 
20A. In a case of Fig. 20B, since the profile's peak becomes a position of 
5 an inflection point in the peak intensity of the lane marker shown in Fig. 
20A, number of times (processes) the microcomputer 24 detecting the 
peak becomes twice. However, since this peak shows both ends position 
of the lane marker width, it is easy to obtain the lane marker width and 
the space between the lane markers from the position the peak appears. 

10 The width of the lane marker obtained by this method becomes more 
accurate compared with the case using the high pass filter to obtain the 
lane marker width. 

Next, a method for alarming in a case the microcomputer 24 is 
determined that the vehicle is deviated of the lane marker or there is the 

15 possibility of deviating by using the above mentioned processing method 
will be described. Three types of alarming methods will be described 
hereunder, and it is possible to select in accordance with situation which 
of the alarming method is to be used, as well as capable of concomitant 
use. 

20 First of all, the alarming method that dependent on the distance 

(distance alarming mode) will be described as a first method. When 
raising the alarm, timing for alarming the driver is important. In the 
deviation alarming, although it is a basic operation to raise the alarm 
when the vehicle is deviated, it is preferable to raise the alarm when the 

25 vehicle is moved closer to the lane marker prior to the deviation so that 
the driver could forestall the lane deviation. Therefore, the 
microcomputer 24 notifies information on danger precisely to the driver 
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by raising different alarming sounds corresponding to the distance from 
the lane markers 13 and 13a to the vehicle 3 (example of distance 1 or 
example of distance 2 shown in Fig. 21B) as shown in Fig. 21. For 
example, as shown in Fig. 21 A, the alarm apparatuses for the lane 
5 deviation 20 and 20' can carry out the alarming corresponding to degree 
of risk of the lane deviation by increasing a sound volume or increasing a 
frequency as the vehicle 3 goes closer to the lane markers 13 and 13a. 
As the way of alarming, it is also recommendable to carry out not only 
the alarming by using either of the sound volume or the frequency of the 

10 alarming sound but also alarming by using both of them at the same 
time. When alarming by using a human voice, it is preferable to alarm 
in accordance with a volume characteristic shown in Fig. 21A. Also, 
when changing the alarm according to the distance, it is recommendable 
to change its changing rate as linearly as indicated in a reference 

15 numeral 34 in Fig. 21 A or in quadric as indicated as a reference numeral 
35. When raising the alarm in proportion to the distance between the 
lane markers 13 and 13a, there may be a case that the alarming sound is 
raised even when the vehicle has changed the lane, so the 
microcomputer 24 stops the alarming by determining that the vehicle 3 

20 changes the lane when the distance between the lane marker 13 and the 
vehicle 3 is exceeded the certain distance. 

A second method that carries out the alarming not only considers 
the distance but also considers vehicle's traversing speed 
(distance-speed alarming mode) will be described hereunder. In the 

25 method that simply carries out the alarming corresponding to the 
distance between the lane markers 13 or 13a and the vehicle 3 as stated 
above, there is the possibility that the alarm apparatuses for the lane 
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deviation 20 and 20' may raise the alarm even though the vehicle is in 
relatively safe traveling situation in a case the driver of the vehicle 3 
who has a habit to safely drives the car in proximity to the lane marker 
13. 

Given this factor, the second alarming method does not simply 
raises the alarm corresponding to the distance between the lane marker 
13 and the vehicle 3, rather, the second alarming method carries out the 
alarming corresponding to the distance between the lane marker 13 and 
the vehicle 3 when the vehicle 3 has traversed over a predetermined 
speed by a speed the vehicle 3 is moving close to the lane marker 13 
(traversing speed) determined by the microcomputer 24, and the 
microcomputer 24 does not carry out the alarming when the vehicle 3 is 
traversing below of the predetermined speed. 

It may be recommendable to provide so that the driver can set a 
value of the predetermined speed or provide the microcomputer 24 to set 
automatically corresponding to each driver by learning. By changing 
over the timing of carrying out the alarming by operation of the driver or 
automatic setting of the microcomputer 24, the alarm apparatuses for 
the lane deviation 20 and 20' can carry out the most suitable alarming 
corresponding to the driver who is driving the vehicle 3. 

Fig. 22 is a flowchart indicating a process of the microcomputer 
24 which changes over ways of alarming corresponding to the traversing 
speed. At first, the microcomputer 24 judges which of the right or left 
lanes markers 13 and 13a the vehicle is closer by using the intensity 
profile or the like (step S40), and recognizes the closer lane marker 13 as 
a white line that is to pay attention (step S41). Next, the 
microcomputer 24 obtains the distance between the paid-attention white 
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line and the vehicle 3 and detects an approaching speed (traversing 
speed) to the paid-attention white line (step S42) and determines 
whether the vehicle 3 is moving close to the paid-attention white line 
with the speed exceeding the predetermined speed or not (step S43). 
5 When the microcomputer 24 determines that the vehicle 3 is moving 
toward the paid-attention white line over the predetermined speed, the 
microcomputer 24 carries out a decision of the alarming sound 
corresponding to the distance to the paid-attention white line (alarming 
intensity deciding process, step S44) and carries out the alarming with 

10 the decided alarming sound (step S45). The alarming will not be 
carried out if the approaching speed is below of the predetermined speed. 

It may be recommendable to enable the microcomputer provide to 
change over between the alarming methods described as the first 
alarming method (distance alarming mode) and the alarming method 

15 described as the second alarming method (distance-speed alarming 
mode) by the automatic learning of the microcomputer 24. In a case of 
changing over the alarming methods by an automatic setting of the 
microcomputer 24, it may be recommendable to adapt the microcomputer 
24 to monitor an alarming time while the distance alarming mode is in 

20 operation and carry out an alteration of the alarming method (operating 
mode) when a situation of raising the alarm is continued for over the 
predetermined time or over a predetermined traveling distance. It may 
also be recommendable for the driver to alter the alarming methods by 
the notification of the microcomputer 24 to the driver rather than the 

25 microcomputer 24 changing the alarming methods automatically. 

A third method of carrying out the alarming obtains a time until 
the vehicle deviates the lane by using the traversing speed and 
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determines whether to carry out the alarming or not corresponding to 
the obtained time will be described with reference to Fig. 23 (time 
alarming mode). 

At first, the microcomputer 24 judges which of the right or left 
5 lanes markers the vehicle is closer by using the intensity profile or the 
like (step S50), and recognizes the closer lane marker as the white line 
that should pay an attention (step S51) as similar to above mentioned 
alarming method, which is the distance-speed alarming mode. Next, 
the microcomputer 24 obtains the distance between the paid-attention 

10 white line and the vehicle 3 and detects the approaching speed 
(traversing speed) to the paid-attention white line (step S52) and detects 
in how many second the vehicle takes to deviate the paid-attention white 
line (expected time to deviate the lane) by dividing the distance to the 
paid- attention white line by the approaching speed (step S53). 

15 The microcomputer 24 does not raise the alarm if determines 

that it takes over the predetermined time for the vehicle 3 to be deviated, 
and raises the alarm if determines that the vehicle deviates within the 
predetermined time (step S54). Consequently, for example, even while 
the vehicle 3 is traveling in middle of the lanes, the alarming is carried 

20 out because the microcomputer 24 determines that it takes a short time 
to deviate the lane when an abrupt handling operation is carried out, 
and even when the vehicle is traveling near by to the lane, the alarming 
is not carried out because the microcomputer 24 determines that it takes 
over the predetermined time to deviate the lane. Therefore, as the 

25 alarming is carried out in accordance with behavior of the vehicle 3, the 
alarm apparatuses for the lane deviation 20 and 20' can serve more 
appropriate information. 
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As described above, although the apparatus for detecting the 
position of the lane marker relating to the present invention has been 
described in the embodiment 1 and the alarm apparatus for the lane 
deviation has been described in the embodiment 2, it should be 
5 understood that the apparatus for detecting the position of the lane 
marker and the alarm apparatus for the lane deviation relating to the 
present invention are not limited within the above described 
embodiments. For example, by concomitantly using "the process for 
detecting the position of the lane marker by obtaining the coordinate of 

10 the horizontal Y axis indicates the highest integral brightness" which 
has been described using the first flowchart and "the process for 
detecting the position of the lane marker by obtaining the coordinate 
width of the group of coordinate of the horizontal Y axis having the high 
integral brightness" which has been described using the second 

15 flowchart, the apparatus for detecting the position of the lane marker 1 
can carry out the detection of the lane marker position more accurately. 

Additionally, in the embodiments of the present invention as 
described above, although there is only one camera 2 provided on the 
vehicle 3 as shown in Fig. 2, it should be understood that the number of 

20 cameras are not to be limited to one, and it is recommendable to provide 
several cameras. By providing the plurality of cameras, it is possible to 
take the image in wide area, since it is possible to take the image of the 
road surface from multiple angles compared with a case that the camera 
2 is only provided one, therefore dead angle can be reduced. 

25 Still additionally, in the embodiments of the present invention, 

although the case of taking the image of the road surface at the back of 
the vehicle 3 by providing the camera 2 at the back of the vehicle 3 has 



-36- 



been described as shown in Fig. 2, it should be understood that the 
position of providing the camera 2 or the direction of taking the image 
are not to be limited to the position or the direction as stated above. 

It is possible to perform the detection of the lane marker position 
by providing the camera 2 at wherever position such as the forward or 
lateral of the vehicle or setting the camera to take the image of wherever 
direction of the road surface as long as the road surface and the lane 
marker is taken in the taken image. 

Also, in the embodiments of the present invention, although the 
apparatus for detecting the position of the lane marker 1 has the 
overlooked view converting unit 8, the intensity profile creating unit 9, 
the memory unit 10 and the lane marker detecting unit 11, it may be 
recommendable to constitute all those units by different semiconductor 
device or constitute all those units by assembling them into one 
semiconductor device. For example, even in a case of performing the 
detection of the lane marker position by adapting a commonly used CPU 
to process a function of the above mentioned device and adapting it to 
exercise a program corresponding to a process the CPU performs, it is 
possible to attain the same effect of the present invention as well as in 
the alarm apparatus for the lane deviation. 
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